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DESCRIPTION 



IMAGING APPARATUS 



5 Technical Field 

The present invention relates to an imaging apparatus for forming 
images by firing a flash. 



Background Art 

10 An imaging apparatus is known which, for flash imaging, fires a 

preflash, and detects reflected light from an object to determine an 
amount of main-flashing light. Imaging apparatus mainly use a CCD 
(Charge Coupled Device) image sensor as their image pickup device. 
Recently, amid the growing trend toward a higher density of pixels on 

15 image pickup devices, a CMOS image sensor is drawing attention as a 
new type of image pickup device. The CMOS image sensor has 
advantages such as random access to and high-speed reading of pixel 
signals, high sensitivity, low power consumption, and the like. 

However, in a conventional imaging apparatus using a CMOS 

20 image sensor, exposure operation and reading operation are performed 

differently for each pixel, and when a preflash is fired, preflash effects are 
given only to a part of the image pickup device, posing a problem of 
difficulty in determining the amount of main-flashing light accurately 
enough. In order to overcome this problem, an apparatus has been 

25 provided which applies a sufficiently long preflash exposure time (see, e.g., 
Patent Document 1 (Japanese Patent Application Publication No. 
2000-196951). 



Disclosure of the Invention 
30 However, when the imaging apparatus applying a sufficiently long 

preflash exposure time fires a preflash under ambient light, the amount 
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of light entering a certain zone of the CMOS image sensor may sometimes 
exceed a dynamic range of the CMOS image sensor, producing image 
signals exhibiting improper levels from that zone, and thus leaving 
unsolved the problem of the difficulty in determining the amount of 
5 main-flashing light accurately enough. 

The present invention has been made in view of such 
circumstances, and an object thereof is to provide an imaging apparatus 
capable of determining the amount of main-flashing light based on 
pre -flashing by a flash highly accurately, even using an image pickup 

10 device formed from a plurality of pixels, each of which can perform any of 
its exposure operation and reading operation at a timing different from 
that of the other, such as an XY addressable image sensor, notably a 
CMOS image sensor. 

In order to achieve the above object, an imaging apparatus of the 

15 present invention includes a flash for emitting light onto an object, an 
image pickup device formed from a plurality of pixels, each of which can 
perform any of an exposure operation and a reading operation thereof at a 
timing different from that of the other, a detector circuit for detecting a 
brightness of image information formed by the image pickup device, and a 

20 control circuit for controlling operations of the image pickup device and of 
the detector circuit. In the imaging apparatus, the control circuit causes 
the flash to fire a preflash before a main-flashing operation by the flash, 
causes the image pickup device to form an image at the time of the 
preflash, and causes the detector circuit to detect the brightness of image 

25 information formed at the time of the preflash, to compute an amount of 
main-flashing light to be fired by the flash on the basis of the detected 
brightness of the image information formed at the time of the preflash. 
The control circuit is characterized by starting the exposure operation 
simultaneously for all the pixels of the image pickup device at the time of 

30 the preflash by the flash, whereby to form the image at the time of the 
preflash. 
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Brief Description of Drawings 

Fig. 1 is a diagram showing a general configuration of an imaging 
apparatus according to Embodiment 1. 
5 Fig. 2 is a diagram of a general configuration of a CCD image 

sensor. 

Fig. 3 is a diagram of a general configuration of a CMOS image 
sensor. 

Fig. 4 is a timing chart showing an operation of the CCD image 
10 sensor. 

Fig. 5 is a timing chart showing an operation of the CMOS image 
sensor. 

Fig. 6 is a diagram showing a control flow of flash imaging. 
Fig. 7 is a diagram showing an example image of an object. 
15 Fig. 8 is a diagram showing an example computation of a 

differential detected value under no ambient light. 

Fig. 9 is a diagram showing an example computation of a 
differential detected value under ambient light. 

Fig. 10 is a diagram showing a flash imaging sequence for a still 
20 image by a conventional CCD sensor. 

Fig. 11 is a diagram showing a flash imaging sequence for a still 
image by a conventional CMOS sensor. 

Fig. 12 is a diagram showing an image formed at the time of a 
preflash by the conventional CCD sensor. 
25 Fig. 13 is a diagram showing an image formed at the time of a 

preflash by the conventional CMOS sensor. 

Fig. 14 is a diagram showing a flash imaging sequence for a still 
image by the CMOS sensor according to Embodiment 1. 

Fig. 15 is a diagram showing an example computation of a 
30 differential detected value in Embodiment 1. 
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Best Modes for Carrying Out the Invention 

In order to achieve the object of determining the amount of 
main-flashing light based on pre-flashing by a flash highly accurately, an 
imaging apparatus is configured such that an exposure operation is 
5 started simultaneously for all pixels of its image pickup device at the time 
of a preflash operation to form an image at the time of the preflash. 
(Embodiment l) 

An imaging apparatus according to Embodiment 1 of the present 
invention will be described below with reference to the drawings. 

10 Fig. 1 is a diagram showing a general configuration of the imaging 

apparatus according to Embodiment 1. 

As shown in Fig. 1, the imaging apparatus according to 
Embodiment 1 includes a lens 11, an iris 12, an image pickup device 13, 
an AGC (Auto Gain Controller) 14, an A/D converter 15, a camera signal 

15 processing circuit 16, a detector circuit 17, a computation unit 18, a 

memory unit 19, a flashing circuit 20, a flash 21, a lens driver 22, and a 
memory unit 23. 

The lens 11 passes light from an object therethrough for focusing 
onto the image pickup device 13, during imaging. The iris 12 changes its 

20 aperture to optimize the amount of light entering through the lens 11, for 
the sensitivity of the image pickup device 13. Also, the iris 12 functions 
as a shutter. The image pickup device 13 includes a plurality of pixels 
with R, G, B color filters arranged therefor, and photoelectrical^ converts 
the light having entered each of the pixels through the lens 11 into an 

25 analog signal (charge). Moreover, the image pickup device 13 is formed 
from an XY addressable image sensor, such as, e.g., a CMOS image 
sensor, and is configured such that each of the plurality of pixels perform 
any of its exposure operation and reading operation at a different timing. 
The CMOS image sensor is advantageous in terms of its low power 

30 dissipation and high-speed reading. 

The AGC 14 amplifies video signals generated by the image pickup 
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device 13. The A/D converter 15 converts the analog video signals 
amplified by the AGC 14 into digital video signals. The camera signal 
processing circuit 16 performs various signal processing, so far well 
known, on the digital video signals converted by the A/D converter 15, 
5 and includes, e.g., a white balance circuit, a Y/C separation circuit, a 
filtering circuit, an aperture controller, a gamma correction circuit, and 
the like, all not shown. The detector circuit 17 detects distributions 
within the screen of brightnesses and colors contained in the video signals 
processed by the camera signal processing circuit 16. A detected value 

10 indicative of brightness is, e.g., the integral of the pixel brightness signal 
levels within the screen. 

The computation unit 18 is formed from, e.g., a microcomputer, and 
controls various parts of the present apparatus on the basis of the 
brightness and color distributions detected by the detector circuit 17 and 

15 the video signals processed by the camera signal processing circuit 16. 

The computation unit 18 computes and outputs, e.g., an exposure timing 
control signal for controlling the exposure operation and the reading 
operation by each pixel of the image pickup device 13, a gain control 
signal for controlling the gain of the AGC 14, a lens control signal for 

20 controlling the focusing of the lens 11 and the aperture of the iris 12 via 
the lens driver 22, and a flash control signal for controlling the firing 
operation of the flash 21 via the flashing circuit 20. The memory unit 19 
stores control data computed by the computation unit 18. 

The flashing circuit 20 drives the flash 21 in accordance with the 

25 flash control signal computed by the computation unit 18, for flash 

imaging. The flash 21 is lit in accordance with a driving signal from the 
flashing circuit 20. The lens driver 22 drives the lens 11 and the iris 12 
in accordance with the lens control signal computed by the computation 
unit 18. The memory unit 23 temporarily stores the video signals (e.g., 

30 moving image information) processed by the camera signal processing 
circuit 16. 
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Fig. 2 is a diagram of a general configuration of a CCD image 
sensor, and Fig. 3 is a diagram of a general configuration of a CMOS 
image sensor. 

As shown in Fig. 2, the CCD image sensor includes a plurality of 
5 pixels 31 arranged in a two-dimensional matrix-like configuration, as 

many V transfer registers 32 as the number of columns of the plurality of 
pixels 31, and an H transfer register 33. Each pixel 31 photoelectrically 
converts incident light into an analog video signal (charge). The 
plurality of V transfer registers 32 transfer the photoelectrically 

10 converted pixel video signals, respectively, i.e., vertically for each pixel 
(each line). The V transfer register 32 transfers the video signals for as 
many pixels 31 as one line transferred from the plurality of V transfer 
registers 32, horizontally for each pixel. 

When the CCD image sensor is exposed to light, the light rays 

15 having entered the pixels are photoelectrically converted into charges 
(video signals), respectively. Each pixel 31 starts storing charge in an 
amount proportional to its incident light. When the CCD image sensor 
is given a signal for transferring the charge, the charges respectively 
stored in all the pixels 31 are transferred simultaneously to their 

20 respective V transfer registers 32. The charges in the pixels 31 (lines) 
transferred to the respective V transfer register 32 are transferred 
vertically for each pixel (each line), to the H transfer register 33. The 
video signals for as many pixels as one line transferred to the H transfer 
register 33 are then transferred horizontally and outputted therefrom, for 

25 each pixel. The plurality of V transfer registers 32 and the H transfer 
register 33 are light-shielded. As a result, the pixel 31 charges once 
transferred thereto are kept constant, unexposed from light from outside. 

As shown in Fig. 3, the CMOS image sensor includes a plurality of 
pixels 41 arranged in a two-dimensional matrix-like configuration 

30 wherein pixels 41 in each column are electrically connected together, and 
a column 42 that transfers charges (video signals) transferred from any of 
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the pixels 41 belonging to each column, horizontally for each pixel. The 
CMOS image sensor does not have a component corresponding to the V 
transfer registers 32 in the CCD image sensor. Thus, each pixel 41 of 
the CMOS image sensor may have a larger surface area than each pixel 
5 31 of the CCD image sensor. Therefore, its dynamic range can be 
increased to improve its sensitivity. The CMOS image sensor can be 
configured to selectively read pixels 41 at desired addresses. On the 
other hand, it cannot read pixels 41 belonging to the same column 
simultaneously, which complicates their exposure and reading operations. 
10 Fig. 4 is a timing chart showing an operation of the CCD image 

sensor, and Fig. 5 is a timing chart showing an operation of the CMOS 
image sensor. 

As shown in Fig. 4, the exposure operation of the CCD image 
sensor is performed simultaneously for all the pixels 31. In the CMOS 

15 image sensor, due to the absence of the component corresponding to the V 
transfer registers 32 of the CCD image sensor, when a certain pixel 41 is 
read, other pixels are affected by ambient light, resulting in improper 
storage of charges. As shown in Fig. 5, in the CMOS image sensor, the 
exposure operation and the reading operation must have a certain 

20 relationship with each other for each pixel 41. In this example, a 

technique is employed to stagger the exposure start timing one line, for 
each pixel (each line) 41 in order to give all the pixels an equal exposure 
time. 

Fig. 6 is a diagram showing a control flow of flash imaging. 

25 As shown in Fig. 6, when a still image pickup mode is selected, an 

integral of brightness signal levels contained in image signals generated 
by the image pickup device 13 is detected by the detector circuit 17, and 
whether ambient light is high or low is determined by the computation 
circuit 18 on the basis of the integral of the brightness signal levels (step 

30 SI). When it is determined that the ambient light is high, the process 
goes to step S2 to perform regular imaging without firing the flash 21. 
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On the other hand, if it is determined in step SI that the ambient light is 
low, the process goes to step S3 to perform flash imaging. Note that the 
process goes to step S3 to perform flash imaging regardless of the result 
of step SI when an operating mode is available which forcibly performs 
5 flash imaging in any ambient light conditions. 

For flash imaging, first, the aperture of the iris 12, the exposure 
time for the image pickup device 13 (shutter time), and the gain of the 
AGC 14 are set (step S3). The aperture of the iris 12 is preferably set 
such that light from a near-range object does not exceed the dynamic 

10 range of the image pickup device 13 during a preflash by the flash 21. 
Pre -flashing is a process intended to compute the amount of 
main-flashing light. And if light exceeding the dynamic range enters the 
image pickup device 13, distorted (saturated) video signals are produced, 
disabling accurate computation of the amount of light for main flashing. 

15 Moreover, the exposure time for the image pickup device 13 is preferably 
set as short as possible. A longer exposure time results in greater 
ambient light effects, which would narrow the dynamic range for 
detecting the amount of pre -flashing light, thus reducing computation 
accuracy for the amount of main-flashing light. The gain of the AGC 14 

20 is preferably set to such a smaller value as to reduce noise effects in the 
video signals. 

Next, while keeping the aperture, exposure time and gain settings, 
before-preflash exposure and reading operations are performed by the 
image pickup device 13 without firing the flash 21, and a before-preflash 

25 detected value (a), i.e., an integral of brightness signal levels contained in 
video signals is detected by the detector circuit 17, and stored in the 
memory unit 23. The before-preflash detected value (a) means a 
detected value of only ambient light without pre-flashed light (step S4). 
Next, while still keeping the aperture, exposure time and gain 

30 settings, a preflash is fired by the flash 21 in a predetermined amount of 
light (step S5). Then, during-preflash exposure and reading operations 
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are performed by the image pickup device 13, and a during-preflash 
detected value (b), i.e., an integral of brightness signal levels contained in 
video signals is detected by the detector circuit 17, and stored in the 
memory unit 23. The during-preflash detected value (b) means a 
5 detected value of pre-flashed light and ambient light (step S6). 
Next, the during-preflash detected value (b) and the 
before-preflash detected value (a) stored in the memory unit 23 are read 
therefrom by the computation circuit 18 to compute a differential detected 
value obtained by subtracting the before-preflash detected value (a) from 

10 the during-preflash detected value (b). The differential detected value 
means a detected value containing only pre-flashed light with ambient 
light excluded (step S7). Next, an amount of light for main flashing by 
the flash 21 is computed by the computation circuit 18 on the basis of the 
differential detected value (step S8). Then, the flash 21 is fired in 

15 accordance with the amount of light computed, to perform flash imaging 
(step S9). 

The before-preflash exposure operation in step S4 and the 
during-preflash exposure operation in step S6 by the image pickup device 
13 are performed preferably as quickly as possible. Flash imaging is 

20 performed generally under low illumination, but almost never without 
ambient light. Moreover, for example, flash imaging is performed to 
highlight a person who is seen dark due to backlight. Such ambient 
light affects the obtaining of correct detected values, particularly, 
during-preflash detected values (b), and this may result in obtaining 

25 incorrect differential detected values. 

Fig. 7 is a diagram showing an example image of an object. 
Moreover, Fig. 8 is a diagram showing an example computation of a 
differential detected value under no ambient light, and Fig. 9 is a 
diagram showing an example computation of a differential detected value 

30 under ambient light. 

A description will be given of a result of a computation made as to 



S05P0751 



an output from the image pickup device, i.e., a differential detected value 
based on detected values. The output is taken at a position defined by 
the vertical dotted line shown in Fig. 7, when an image including a round 
image A in the middle of the screen shown in Fig. 7 is formed by flash 
5 imaging. 

As shown in Fig. 8, under no ambient light, the output from the 
image pickup device before firing a preflash is zero, and thus its 
before -pre flash detected value (a) is also zero. At the time of the 
preflash, a during-preflash detected value (b) exhibiting a large output 
10 level for a portion corresponding to the image A is obtained. As a result, 
a differential detected value coincides with the during-preflash detected 
value (b). 

As shown in Fig. 9, under ambient light, a before -preflash detected 
value (a) corresponding to the ambient light is obtained. At the time of 

15 the preflash, the ambient light and pre-flashed light enter the image 
pickup device. At this moment, any brightness signal exceeding the 
100% output level of the image pickup device, i.e., any brightness signal 
exceeding the dynamic range of the image pickup device is clipped. As a 
result, a differential detected value becomes smaller and distorted due to 

20 the clipped portion being excluded therefrom. Therefore, a correct 

amount of light for main flashing cannot be computed. As mentioned 
earlier, flash imaging under almost no ambient light is rarely performed. 
Consequently, the exposure operations before and during a preflash must 
be performed as quickly as possible to reduce the ambient light effects 

25 and thus to give a sufficient margin to the dynamic range of the image 
pickup device at the time of the preflash. 

Fig. 10 is a diagram showing a flash imaging sequence for a still 
image by a conventional CCD sensor, and Fig. 11 is a diagram showing a 
flash imaging sequence for a still image by a conventional CMOS sensor. 

30 Moreover, Fig. 12 is a diagram showing an image formed at the time of a 
preflash by the conventional CCD sensor, and Fig. 13 is a diagram 
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showing an image formed at the time of a preflash by the conventional 
CMOS sensor. 

As shown in Fig. 10, when the conventional CCD sensor is used as 
the image pickup device, a before-preflash exposure is started at a time 
5 Tl and a during-preflash exposure is started at a time T2, in a moving 
image pickup mode. Detected values are obtained therefor, respectively, 
and their differential detected value is then computed. Subsequently, 
proceeding to the still image pickup mode, flash imaging by means of 
main flashing is performed. As shown in Fig. 12, pre-flashing in the 

10 during-preflash exposure affects the entire area of the screen evenly. 

As shown in Fig. 11, even when the conventional CMOS sensor is 
used as the image pickup device, similarly, a before-preflash exposure is 
started at the time Tl and a during-preflash exposure is started at the 
time T2, in the moving image pickup mode. Detected values are 

15 obtained therefor, respectively, and their differential detected value is 
then computed. However, as shown in Fig. 13, the preflash duration is 
so short as 10 |j,sec that pre-flashing in the preflash exposure affects only 
a limited area (upper zone) of the screen. As a result, from the 
remaining area (middle and lower zones) of the screen, one obtains a 

20 detected value representing only ambient light, without preflash effects. 
Therefore, the during-preflash detected value cannot be obtained highly 
accurately, and hence the amount of light for main flashing cannot be 
computed highly accurately, either. 

Fig. 14 is a diagram showing a flash imaging sequence for a still 

25 image by the CMOS sensor according to Embodiment 1. 

As shown in Fig. 14, for starting a before-preflash exposure and a 
during-preflash exposure, the imaging apparatus according to 
Embodiment 1 of the present invention sweeps away charges from all the 
pixels of its image pickup device 13, whereby the exposure operations are 

30 started simultaneously for all the pixels within the screen. Pre-flashing 
in the during-preflash exposure operation affects the entire screen evenly 
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from top to bottom. Therefore, a during-preflash detected value can be 
obtained highly accurately. On the other hand, the imaging apparatus 
of the present invention cannot read all the pixels within the screen 
simultaneously, and thus, the pixels are sequentially read one line at a 
5 staggered timing. Before -pre flash and during-preflash exposure times 
are designed to last longer for pixels in lower lines, thus exposing pixels 
in a first line for the shortest time (e.g., 1/4000 sec), and exposing pixels 
in a last line for the longest time (e.g., one over some hundreds of 
seconds). 

10 The before-preflash and during-preflash exposure times differ from 

upper to lower zones of the screen. However, by setting shorter exposure 
times, the ambient light effects upon the during-preflash detected value 
can be reduced. Since pre-flashing is an operation originally intended to 
compute the amount of main-flashing light, the pre-flashing is acceptable 

15 as long as it allows for accurate detection of the amount of light reflected 
from an object during the preflash. Furthermore, the imaging apparatus 
according to Embodiment 1 detects a before-preflash detected value in 
addition to a during-preflash detected value, and subtracts the 
before-preflash detected value from the during-preflash detected value, to 

20 obtain their differential detected value containing only pre -flashed light 
with ambient light excluded. As a result, the difference between the 
exposure times applied to the upper and lower zones of the screen in the 
before-preflash and during-preflash exposures is cancelled, whereby a 
differential detected value can be obtained which contains only the 

25 pre-flashed light with ambient light excluded. Therefore, further more 
accurate differential detected values can be obtained, and further more 
accurate amounts of main-flashing light can be obtained. 

Fig. 15 is a diagram showing an example computation of a 
differential detected value in Embodiment 1. 

30 A description will be given of a result of a computation made as to 

an output from the image pickup device, i.e., a differential detected value 
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based on detected values, similarly to the differential detected values 
shown in Figs. 8 and 9. The output is taken at the position defined by 
the vertical dotted line shown in Fig. 7, when the image including the 
round image A in the middle of the screen shown in Fig. 7 is formed by 
5 flash imaging. 

As shown in Fig. 15, before a preflash, pixels in the upper zone of 
the screen are exposed for so short a period as 1/4000 sec, and thus, the 
image output level is almost zero. And pixels positioned in lower lines of 
the screen have longer exposure times, and thus ambient light effects 
. 10 gradually grow large in the image output level. During the preflash, a 

portion corresponding to the image A produces a large output level, and is 
also affected by the ambient light. However, since the amount of 
ambient light contained in the incident light both before and during the 
preflash is smaller than the amount of pre-flashing light, and thus, one 
15 can obtain such an image output level as not to exceed the 100% output 
level of the image pickup device, i.e., the dynamic range of the image 
pickup device. 

As described above, according to the imaging apparatus of 
Embodiment 1, during a preflash operation, an exposure operation is 

20 started simultaneously for all the pixels of the image pickup device 13 to 
form an image at the time of the preflash. Thus, the preflash effects can 
be extended over the entire area of the image pickup device, while 
reducing the exposure times for the image pickup device. Therefore, this 
is advantageous in obtaining the amount of main-flashing light with high 

25 accuracy. Moreover, the preflash time of the flash 21 is set to such a 

small value that the amount of light entering the image pickup device 13 
does not exceed the dynamic range of the image pickup device 13. As a 
result, an undistorted image faithfully reproducing the amount of 
incident light can be formed by the image pickup device 13. Thus, this is 

30 also advantageous in obtaining the amount of main-flashing light with 
even higher accuracy. 
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Furthermore, by detecting a before-preflash detected value in 
addition to a during-preflash detected value, the before-preflash detected 
value is subtracted from the during-preflash detected value, to obtain 
their differential detected value containing only pre-flashed light with 
5 ambient light excluded. As a result, the differential detected value 

containing only the pre-flashed light with the ambient light excluded can 
be obtained. Consequently, this is further advantageous in obtaining the 
amount of main-flashing light with high accuracy. 

Note that in Fig. 14, during a period in which before-preflash and 

10 during-preflash operations are performed by the image pickup device 13, 
output from the image pickup device 13 occurs at intervals of 2 Vs (every 
two vertical sync signals), providing only incomplete video signals 
(moving image). Additionally, affected by the difference in exposure time 
from one zone to another within the screen, a distorted video is outputted 

15 from the image pickup device during this period. In order to overcome 

this shortcoming, the following configuration may be implemented. That 
is, video signals generated at a timing some Vs ahead of this period are 
stored in the memory unit 23 beforehand, and when starting a 
before-preflash exposure operation, the image pickup device 13 reads the 

20 video signals generated at the timing some Vs ahead which have been 
stored in the memory unit 23, instead of an image to be formed by the 
image pickup device 13, and outputs the read video signals to a 
downstream image recording system or image output system. This 
permits a user to be unaware of distortions in the video. 

25 

Industrial Applicability 

According to the imaging apparatus of the present invention, 
during a preflash operation by a flash, an exposure operation is started 
simultaneously for all the pixels of the image pickup device, whereby 
30 preflash effects can be extended over the entire area of the image pickup 
device, while reducing the exposure times such that the amount of light 
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entering the entire area of the image pickup device does not exceed the 
dynamic range of the image pickup device as much as possible. 
Consequently, this is advantageous in obtaining the amount of 
main-flashing light with high accuracy. 



